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Abstract 

We study continuous time Bertrand oligopolies in which a small number of firms producing 
similar goods compete with one another by setting prices. We first analyze a static version of 
this game in order to better understand the strategies played in the dynamic setting. Within the 
static game, we characterize the Nash equilibrium when there are N players with heterogeneous 
costs. In the dynamic game with uncertain market demand, firms of different sizes have different 
lifetime capacities which deplete over time according to the market demand for their good. We 
setup the nonzero-sum stochastic differential game and its associated system of HJB partial 
differential equations in the case of linear demand functions. We characterize certain qualitative 
features of the game using an asymptotic approximation in the limit of small competition. The 
equilibrium of the game is further studied using numerical solutions. We find that consumers 
benefit the most when a market is structured with many firms of the same relative size producing 
highly substitutable goods. However, a large degree of substitutability does not always lead to 
large drops in price, for example when two firms have a large difference in their size. 

1 Introduction 

We study competitive markets with a small number of players in which firms use price as their 
strategic variable in an uncertain demand environment. These are known as Bertrand oligopolies. 
The firms are selling differentiated but substitutable goods. Many products, for instance consumer 
goods, are sold in markets that fit this structure. An example might be Pepsi and Coca-Cola in 
the market for soft drinks. Oil, coal and natural gas are commodities that can be substituted for 
one another for energy production, but which have different prices per unit of energy produced. 

In this paper, we analyze price setting competition in the case of differentiated goods, and 
in continuous time under randomly fluctuating demands. These are nonzero-sum stochastic dif- 
ferential games that may be characterized by systems of Hamilton-Jacobi-Bellman PDEs. The 
large literature on oligopolistic competition deals primarily with the static problem, and we refer 
to Friedman [TSj and Vives |27j for background and references. Cournot [11] provided the first 
analysis of an oligopoly where firms' strategic interactions are taken into account. He assumed 
that firms compete using quantity as their strategic variable and then take prices as determined 
by the market through an inverse demand function, that is, a mapping from quantity to price. In 
a scathing review of Cournot 's paper, Bertrand [7] argued that firms compete using price as their 
strategic variable and then produce to clear the market demand arising from a demand function, 
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that is, a mapping from price to quantity. In actuality, some markets may be better modeled as 
Cournot, and others as Bertrand, and we do not enter that debate here. 

In both these original models, however, the goods were homogeneous, that is perfectly substi- 
tutable. This means that the only difference between the firms is the price they set or the quantity 
they produce. In the price setting game, this induces the behavior that, if the prices between 
two goods are not equal, consumers will only purchase the lower priced good. Here, we do not 
assume goods are perfectly substitutable, and therefore, if firms have prices that differ, they may 
all still receive some demand from the market. Models of product differentiation originated with 
Hotelling [23] and Chamberlin [10], and were extended by d'Aspremont et al. |12j . among others. 
See Friedman [181 Chapter 3] for an excellent discussion. 

Most of the continuous-time models are in a linear-quadratic (LQ) set-up, which has convenient 
analytical properties. We refer to Engwerda |15j for details, and Hamadene [20J for an approach 
via BSDEs. Jun and Vives |24] work within the context of a differential game of a duopoly with 
differentiated products. Their general model allows for either Cournot or Bertrand competition in 
which the players control the rate of change of the rate of production or price, respectively, in the 
LQ setting. 

There has been much recent interest in other types of stochastic differential games. We mention, 
for example, Lasry and Lions [25J, who consider Mean Field Games in which there are a large number 
of players and competition is felt only through an average of one's competitors, with each player's 
impact on the average being negligible. Bensoussan et al. [6\ study leader-follower differential 
games in real options problems. Ekeland and Pirvu [H] and Bjork and Murgoci [9] analyze time- 
inconsistent control problems which can be viewed as games against one's future self. Energy 
markets in which a small number of firms control supply can be viewed as Cournot oligopolies and 
they are analyzed in the context of exhaustible resources in Harris et al. (221 . 

The state variable of the firms in our model is their remaining lifetime capacity. This is a 
quantity whose value at time zero represents all of the possible production a firm can undertake 
over its lifetime before it goes out of business. The primary reason for this choice is that it is 
a natural way to capture the notion of relative sizes of firms. A firm with a very large lifetime 
capacity is a major market participant whose decisions greatly affect the prevailing price in the 
market. A firm with a very small lifetime capacity has very little market power. Here, we analyze 
the effect that participant size has on Bertrand markets over time. For producers of consumer 
goods, the lifetime capacities could be proxied by past volume of sales projected forward into the 
expected lifetime of the firm. In the case of exhaustible resources, the state variables would be 
estimates of remaining oil, coal or natural gas reserves, for instance. 

In Section [2j we set up the static version of our price setting game and prove the existence 
and uniqueness of a Nash equilibrium. The resulting equilibrium price functions are inputs for 
Section [3] where we present the dynamic Bertrand game. We characterize the price strategies of the 
firms using the solution to a system of coupled nonlinear PDEs. We analyze in detail the problem 
of a duopoly with linear demand functions and the related monopoly problem. Analytically, we 
obtain an asymptotic expansion in powers of a parameter that represents the extent of competition 
between the firms in a deterministic game. In Section [4| we present the numerical solution of our 
system of PDEs that allows us to characterize the price strategies and resulting demands of firms 
in the stochastic game. Finally, in Section [5j we conclude and discuss further lines of research. 
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2 Static Bertrand Game 



The main purpose of this paper is to analyze a dynamic price setting game in continuous time. 
In order to fully understand this game, we first analyze a static version of the game and prove 
existence and uniqueness of a Nash equilibrium. This is used in establishing the system of HJB 
PDEs of the dynamic game in the next section. 

We assume a market with N firms where each firm uses price as a strategic variable in noncoop- 
erative competition with the remaining firms. Associated to each firm i G {1, . . . , iV} is a variable 
Pi G R+ that represents the price at which firm i offers its good for sale to the market. We denote 
by p the vector of prices whose ith element is pi. 

2.1 Systems of Demand 

Given prices of the firms, we specify the resulting market demands for each firm's good. For each 
firm i G { 1 , . . . , N} , there exists a demand function Df (pi , p 2 , ■ ■ ■ ,Pn) '■ ->• We first state 
some natural properties of these demand functions. 

Assumption 2.1 (Properties of Demand Functions). For all i = 1,...,N, Df is smooth in all 
variables, and 

dD N dD N 
D%(0,...,0) >0, ^<0, and — i- >0 fori^j. 

opi Opj 

We further assume that firms are distinguished only by the prices they set. 

Assumption 2.2 (Exchangeability of Firms). For fixed pi, ■ ■ ■ ,pn an d all i,j £ {1, . . . , N}, 

Df (pi, ...,pi,...,pj,.. .,p N ) = Df (pi, . . . ,pj, . . . ,pi, . . . ,p N ) . 

This implies that the demand function is invariant under permutations of the other firms' prices. 
That is, for any j, k G {1, . . . , N} \ {i}, we have 

Df (pi, • • • ,Pi, ■ ■ ■ ,pj, . . . ,Pk ■ ■ ■ ,Pn) = Df (pi, . . . ,pi, . . . ,p k , ...,pj...,p N ). 

Smoothness of these functions is for convenience, and, naturally, the market has positive demand 
if the prices are low enough. The key assumption in the above is that demand for an individual 
firm is decreasing in the firm's own price and increasing in the price of their rivals. This assumption 
implies that we only deal with substitute goods. A classical example is Coca-Cola versus Pepsi. 
However, such goods can also be of different kinds and thus not directly replaceable, yet they still 
exhibit substitutability. For example, an iPod and a compact disc. One cannot directly replace the 
other, but we expect a drop in the price of iPods to cause a drop in the demand for compact discs. 
Contrary to this type of good, there are goods known as complementary goods, such as hot dogs 
and hot dog buns, but we do not consider those kinds of competition here. 

We now make additional convenient assumptions. 

Assumption 2.3 (Finite Choke Price). Fix a firm i G {1, . . . ,N}. For any fixed set of prices 
P-i = (pi, . . . ,pi-i,p-i+i, . . . ,Pn), we assume there exists a "choke price", pi (p-«) < oo, such that 

Df (pi, . . . ,pi_i,pi,p i+ i, . . . ,pjv) = 0. (1) 



Note that this "choke price" is unique by Assump tion 2.1 because dDf jdpi < 0. This price is 

N 
N 



also positive by the same assumption and Assumption 2.2 because Df (0, . . . , 0) = Df (0, . . . , 0) > 



Df (0, . . . , 0, p (0) , 0, . . . , 0) = 0. This implies pi (0) > 0. 
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Remark 2.1. For example, suppose each firm's demand depends on its rivals' prices only through 
their sum: = f \Pi,Y2j^iPj) where f(x,y) : x M + — > M is a smooth function which is 

increasing in y, decreasing in x, and such that there exists a solution x to f(x, y) = for every y. 
Then, it is easy to see that this demand system satisfies Assumptions |2.1[ |2.2| and |2.3| 



The actual demand that each firm faces cannot be negative as the firms are suppliers. For a 
fixed price vector p, we define Di(p), without the superscript, as the actual demand firm i receives 
in the market. Suppose first, for simplicity, that p\ < p2 < ■ ■ ■ < pn- If this is not the case, then 
we can re-order the firms, carry out the following procedure, and then return them to their original 
order once their demands have been determined. We next show that if prices are ordered, then this 
same ordering carries over to the demands. 

Proposition 2.1 (Price order implies demand order). Fix a vector of prices p. Suppose they are 
ordered such that p\ < p2 < • • • < pn- Then, 

D? {px, ...,p N )>D? ( Pl , ...,pn)>-~>Dn (Pi, • • ■ ,Pn) ■ 

Proof. Using the ordering of the prices, the properties of the derivatives of the demand functions, 
and Assumption \2.2\ we have 



Dn(pi,---,Pn-2,Pn-i,Pn) = Dn-i(Pi,---,Pn-2,Pn,Pn-i) 

< D N-1 (Pl,---,PN-2,PN-l,PN-l) 

< {Pl, ■ ■ ■ ,PN-2,PN-1,PN) ■ 

The result then follows for all Df by applying the same procedure. ■ 

To determine the actual demand Di(p), we begin with the demand function D^(j>i,p2, ■ ■ ■ , Pn)- 
If Dj~[(p) > 0, then it must be the case that Df(p) > for all i = 1, ... ,N by Proposition 2.1 
The actual demand that each firm faces is Df(p). Hence, 

Diip) = Df(p) for ah % = 1, . . . , JV, 

and all the demands are determined. Otherwise, if D^(p) < 0, then the price pn is too high 
relative to the preference structure of the market to make any sales in the market. Thus, this firm 
will receive no demand from the market and the demand of the remaining firms must reflect this 
fact. The demand for firm N is set to zero, D^{p) = 0, and the demand for the remaining firms is 
determined by considering their residual demand functions, which we now define. 

Let us consider the general case of residual demand for n firms when all firms i > n receive zero 
demand at the current set of prices. 

Definition 2.1 (Consistency of Demand). For each n G [1, N — 1], we define the n-firm system of 
demand functions from the (n + l)-firm system of demand functions through 

D" (pi,P2, • • • ,Pn) = D'1 +1 (pi,p 2 , ■ • .,p n ,Pn+i) for i = 1, . . . , n, 

where p n+1 (pi, . . . ,p n ) is defined by D™+\ (pi, . . . ,p n ,p n +i) = 0. 

Definition 



2.1 



encapsulates that, if firm n + 1 sets price so high that D^\ x {p) < 0, demands for 
firms i < n + 1 are consistently adjusted as if firm n + 1 set price p n +i that realizes it exactly zero 
demand. This will give rise to actual demands which are continuous as a firm raises its price through 
the level at which it receives zero demand, and the market effectively has one less player. We shall 
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see in Remark 2.3 that a common way of generating demand systems through a representative 



consumer's utility maximization problem yields a demand system with this consistency property. 
In Definition |2.1[ we do not necessarily know that p n +\ exists for all n. We shall prove that 



they do exist in Proposition 2.2, but first we need to make one additional assumption. 



dDV 



Assumption 2.4. For all n G [1, N — 1] and all i = 1, . . . , n, we assume -g-f- < 0. 



We will see in Propositions 2.2 and |2.3| that the other natural properties of Assumptions 2.1 



2.2 and 2.3 are inherited by the lower level demand functions. However, it is necessary to assume 
that lower level demand functions are decreasing in each player's own price. 

Proposition 2.2. For each n£ [1,JV— 1], there exists a finite "choke price" p n +i(pi, ... ,p n ) where 



DZXi(pi,...,Pn,Pn+l) =0. 



Proof. See Appendix [A} 



Proposition 2.3 (Inherited Demand Properties). The functions Df, as defined in Definition 

dD n 

are smooth in all variables, and -q^- > for ij^j, and i = 1, . . . , n. 



2.1 



The functions Df also inherit the symmetry of the functions Df from Assumption 



2.2. Fur- 



thermore, they inherit the ordering of demand shown in Proposition 2. 1 . That is, for a fixed vector 
of prices p, ordered such that p\ < p2 < • • • < pn, w ^ have for any 1 < n < N 

Df (px, . . . ,p n ) > D n 2 (p!, . . . , Pn ) >--->D n n (px, ..., Pn ). 

Proof. The smoothness of the functions Df clearly comes directly from that of Df . Furthermore, 
the symmetry of these functions is also clearly inherited. To show the positive transverse derivative, 
we simply compute. We show only at the level N — 1; for all n G [1, iV — 1], the property will follow 



in the exact same way from the function at the level n + 1 using Assumption 2.4 We first take the 
derivative of Eqn. ([!]) with respect to pj for j ^ N, which gives 



dp N _ dD^/dp 



> 0, because 



3D 



> and 



3D 



dpj dDf/dp N ' dpj dp N 

Then, for i = 1, . . . , N — 1 and j G {1, . . . , N — 1} \ {i}, we have 



< 0. 



dD 



N-l 



3D? 8Df dp N 



dp. 



This is positive because of Assumption 



d Pj 



+ 



dp N dpj ' 



2.1 



and because 



> for any j ^ N. With these 



properties, the ordering of demands follows by applying the exact same proof as Proposition 2.1 



We can now specify completely the demand function that each firm faces for a given set of 
prices. 

Definition 2.2. (Actual Demands) Given an ordered price vector p: 
• If D%(p) > 0, then Diip) = Df(p) for alU = 1, . . . , N. 
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Otherwise, find n £ {1, . . . , N — 1} such that 

D^tl (pi,..-,p n ,Pn+i) < 0, and 



^ (pi,--.,Pn)>0. 



For such an n, the actual demands of firms n + 1, • • ■ , N are equal to zero, and Df give the 
actual demands for each firm i € {1, . . . , n}: 



A Op) 







for i = 1, . . . , n 
for i = ra + 1 , . . . , N 



If no such n exists, then Di(p) = for all i = 1, . . . , JV. 



2.2 Example: Linear Demand 

We present demand functions that are affine in the prices of all firms. This is the demand structure 
we will use in the dynamic game of the following sections. For fixed N, we start with positive 
parameters A,B,C such that B > (N — \)C. This latter condition on the parameters will be 
justified in what follows. With these parameters, we define 



D? (pi, • • • ,Pn) 



A — Bpi + C Pji for i = 1 , . 



Notice that D%(0, . . . ,0) = A > 0, and £>f is of the form given in Remark 



2.1 



(2) 



Therefore the 



demand functions satisfy Assumptions [2T} |2.2| and 2.3 



Proposition 2.4. For each n € [1, JV — 1], we have 

Df (pi, . . . ,p n ) = a„ - 6 n pi + Cn ^Pj, /or i 



1, . . . ,n, 



(3) 



where, for 2 < n < N, 



a n -i =a n [l + 



bn 1 



b 2 

n 



Cn-l 



1 + 



(4) 



with a 7v = A, bjy = B and cat = C. 

Proof. Using Definition 2.1 we solve for the choke price p/v by setting in Eqn. ([2]) to zero and 
solving for pjy. This results in p/v = B^ 1 (^A + C Yl^i Pi) ■ Substituting into Eqn. (2 ) we obtain, 
for t = l,..., TV- 1, 



D 



N-l 



(Pi 



,PN-1, 



A 1 + 



B 1 



j<JV-l 



which establishes Eqn. Q for n = N. We can repeat this procedure for 1 < n < N — 1, where we 
find Pn+i = («n.+i + c n+ i X^r=iP*)i an d this results in the demand system at the level n being 
given by Eqn. ([3]) with the recursively defined parameters given in Eqn. Q. ■ 
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Proposition 2.5. The explicit solution of the recursion is given by 

„ _ a h /3 + (n - 2) 7 7 



" /3 + (n-l) 7 ' " ( j9 + ( n _i) 7 )( J g_ 7 )' « ( (9 + (ra _i) 7)((9 _ 7 ) 
where we define 

( ' a = y.A.(% + l), /3 = 7 .f^-(iV-2i). (Gi 



' (B — (N — 1)C) (B + cy \C J' H ' \C 

Proof. Simple algebra shows that the expressions in Eqn. ([5]) satisfy the recursions in Eqn. Q. All 
that remains to show is that a n ,b n ,c n are positive and well-defined. By examination of Eqn. ([5]), 
this will be the case provided a,/3, 7 are positive, and f3 > 7 because of the denominator in the 
last two expressions in Eqn. ([5]). We see from the first expression in Eqn. ^ that a > if 7 > 0. 
Furthermore, we have that f3 > 7, and therefore (3 > if 7 > and if -B > (JV — 1)C. This is 
exactly the condition we assumed above on the parameters B and C. Therefore, we need only show 
that 7 > 0, but this again will be true if B > (JV — 1)C. Hence, we have that a n , b n , c n are positive 
for all n. M 



Remark 2.2. Note that Assumption 2.4 is satisfied by the demand functions in Eqn. (13]) because 

dDV- 



—b n < 0, for all n < N and i < n. 

Remark 2.3 (Generating Demand Systems). One can generate demand systems that satisfy our 
assumptions by starting with a utility function and using the utility maximization problem of a rep- 
resentative consumer. Let U(q) : — > K be a smooth and strictly concave utility function, where 
q is a vector representing quantities of the different products. We assume that a representative 
consumer solves the problem of maximizing utility of consumption minus the cost of that consump- 
tion: maxq U (q) — pq. One then obtains inverse demands from the first order conditions of this 
maximization problem p = Vi7. The Jacobian of the inverse demand system equals the Hessian of 
U, which implies the system is invertible. We obtain the direct demand system {D^} by inverting 
this system for quantity as a function of price. Concavity of U implies dDf /dpi < 0, but we cannot 
tell directly from U if dDf /dp j > holds for j ^ i. Therefore, an additional assumption must 
be made at the level of the demand functions in order to model substitute goods. However, the 
consistency property in Definition |2.1| is guaranteed. Suppose firm is removed from the utility 
function, then the demand functions {Df^ 1 } derived this way, inverting Vf7 after setting = 0, 
are consistent with the {Df}, and similarly for the lower level demand functions {Df}. The linear 



system of demand introduced in Section 2.2 can be obtained by using the quadratic utility function 



N 1 N 

t=i y i=i i^j 

While it is not necessary to assume that demand is derived from utility, it can be shown that, 
under some mild conditions, given a system of demand, there exist preferences that rationalize that 
demand, which result in a utility function consistent with that demand system. See Mas-Colell 
et al. 126, Section 3. HI for more details. 



2.3 Nash Equilibrium 

We now analyze the static Bertrand game. Each firm i £ {1, . . . , N} has an associated constant 
marginal cost, denoted by Sj. We denote by s the vector of costs with ith element equal to Sj. Each 
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firm chooses its price to maximize profit in a non-cooperative manner, but they must do so while 
taking into account the actions of all other firms. Firms choose prices to maximize profit in the 
sense of Nash equilibrium. The profit function IT : xl-> M + for firm i is given by 

Hi (pi,P2, ■ ■ • ,PN, Si) = Di(p) ■ (pi - Si) , (7) 



where Di{p) was defined using the procedure in Section 2.1 

In order to simplify exposition, we assume, possibly after a suitable relabeling, that firms are 
ordered by costs: 0<si<S2<---<sat. 

Definition 2.3. A vector of prices p* = (Pi,P2, ■ ■ ■ >Pn), is a Nash equilibrium of the Bertrand 
game if 

p* = Si whenever Di (p*) = 0, (8) 

and 

p* = argmaxil; [p\,p$, . . . ,p*_ x ,p,p* +1 , . . . ,p* N ,Si) (9) 

p> Si 

for alli = l,...,JV. 

Eqn. 4§) says the Nash equilibrium is a fixed point of best-responses. Eqn. (TsT) says that whenever 
a firm receives zero demand in equilibrium, it sets its price equal to cost, which is a best-response, 
meaning it satisfies Eqn. ([9]). This makes the best-response p* a well-defined function. 

In the game with heterogeneous costs, some firms may receive zero demand, and so we first con- 
sider subgames which, for n = 1, . . . , JV, involve only the first n players. Let p* ,n = (p 1 ' n , • ■ • ,Pn n , 
s n +i, . . . , sn), where the first n components solve the Nash equilibrium problem with profit func- 



tions II™(pi, . . . ,p n ) = Df(p\, . . . ,p n ) ■ (pi — Si) and Df, introduced in Definition 2.1 is the demand 
function for the n-player game. In other words, 

Pi' =argmaxIL : [p{ ,p 2 ' , . . . ,PiLx,P,Pi+!, ■ ■ ■ ,P n ' ), i = l,...,n. (10) 

p>0 

Assumption 2.5. We assume that, for each n = 1,...,N, there exists a unique solution to the 



system of maximization problems in Eqn. (10). 

Sufficient conditions for the existence of a unique best-response function for each player are 
existence of a unique solution to the first-order conditions: 

-Q^y' n ) [PT - + W' n ) =0, i = l,...,n, (11) 

and strict concavity of II" as a function of pi . It is straightforward to show that the latter is implied 
if we adopt the assumption that D"(pi, . . . ,p n ) is concave as a function of p^, some weaker conditions 
on the Df are discussed in Vives [271 Chapter 6], but we do not pursue those here. Finally, for a 



unique intersection of the best-reponse functions, hence a unique solution to Eqn. ( 10 ), a well-known 
sufficient condition is diagonal dominance of the Hessian of II™: 



dpi 



d 2 n? 



dpidp. 



<0, i = l,...,n. (12) 



Again, we refer to Vives |27j for details. 

In the subgames, prices p*' n are non-negative, but the resulting demands may be negative. 
Therefore, these are only initial candidates for the Nash equilibrium of our problem, but they are 
used in the proof of the next section. We will also provide an example of such a Nash equilibrium 
under linear demand functions. 
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2.3.1 Existence and Construction of Nash Equilibrium 

Let p* denote the vector of prices in equilibrium. We will see that the Nash Equilibrium will be 
one of three types: 

(I) All iV firms price above cost. In this case, p* > Sj for all i = 1,...,N, and the Nash 
equilibrium is simply the iV-player interior Nash equilibrium given by p* = (pl' N , • • • , p^ N 



where the p*' N solve Eqn. (1 1 Oh with n = N. 



(II) For some < n < N, firms 1, . . . , n price strictly above cost and the remaining firms set price 
equal to cost. In other words, p* > Sj for i = 1, . . . , n, and pj = Sj for j = n + 1, . . . , N. 
The first n firms play the interior n-player sub-game equilibrium as if firms n + 1, . . . , N do 
not exist. These firms are completely ignorable because their costs are too high. The Nash 
equilibrium is p = {p{ , ■ ■ ■ ,Pn , s n +i, • • • , sn) ■ 

(III) For some (k, n) such that < k < n < N , firms 1, . . . , k price strictly above cost (if k = then 
no firms price strictly above cost), and the remaining firms set price equal to cost. In other 
words, p* > Si for i = 1, . . . , k and p^ = Sj for j = k + 1, . . . , N. This type differs from Type 



(II) in that firms k + 1, . . . , n are not ignorable: their presence is felt in the pricing decisions 
of firms 1, . . . , k, and we say that firms k + 1, . . . , n are on the boundary. On the other hand, 
firms n + 1, . . . , N are completely ignorable. This case arises when firms k + 1, . . . , n would 
want to price above cost if they were ignored, but they do not want to price above cost in 
the full sub-game that includes them as a player. 



In order to characterize Type (III) equilibria, for any fixed n G {!,••• , N} and for any k 



, n, let p b > n ' n fc ; be the vector where for every i = 1, . . . , k we have 

b,n,n—k r^n I b,n,n—k b,n,n—k b,n,n—k b,n,n—k \ i \ /1 o\ 

Pi'' = axgmaxDMPi ,---,PiU ,P,P i+ i > Sk+i, ■ ■ ■ , s n J • {p - Sj) , (13) 

p>Si K ' 

and for which p b ' n ' n ~ k = s ■ for j = k + 1, . . . , JV. This means that firms 1, . . . , k are setting 
prices by maximizing profit in the sense of Nash equilibrium given that firms k + 1, . . . , n are on 
the boundary and firms n + 1, . . . , N are ignorable. We note that this solution is different to the 
solution p*' k because the demand function used in their profit maximization is Df and not D\. 
This is exactly what we mean by the fact that firms k + 1, . . . ,n are on the boundary and hence 
not ignored. Explicitly, the superscript (b, n,n — k) stands for boundary, n firms entering into the 
demand function, and n — k firms on the boundary, i.e. not ignorable. 

The following lemma shows that if firm n would see non-positive demand at cost, for some fixed 
set of prices pi, ■ ■ ■ ,p n -i, then, at the same fixed prices, and with firm n pricing at cost, firm (n + 1) 
will also see non-positive demand at cost. 

Lemma 2.1. Fix an n G {1, . . . , N — 1} and fix p±, . . . ,p n -i- Suppose D™(pi, . . . ,p n -i, s n ) < 0. 
Then D™+\ (pi, . . . ,p n -i, s n , s n+1 ) < 0. 

Proof. Recall that p n +i is the unique price as a function of (px, • • • ,Pn) that equates the demand 
of firm (n + 1) to zero. For the fixed pi, ■ ■ ■ ,p n -l an d s n , we have 

D^+l(p 1 ,..., Pn _ 1 ,s n ,p n+1 ) = 0. (14) 
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Then, 



Dn (Pi, ■ ■ ■ ,Pn-l,S n ) = D^ +1 (pi , . . . , p n -i , S n , f> n +l ) 

^ D n+1 (jPl,'-,Pn-l,Pn+l,Sn+l) 
^ D n+1 (piT--,Pn~l,Sn,S n +l) , 

where the last inequality holds if s n < p n +i- Alternatively, if s n > p n +i, we note that then we also 
have s n +i > s n > p n +i and thus 

D n+1 (PIj • • • ,Pn-l,s n ,s n+1 ) < D%H (pi, . . .,p n -i, s n ,p n+1 ) = 0. 

Hence, regardless of the relative size of s n and p n +i we have D (pi, ■ ■ ■ ,p n -i, s n , s n +i) < 0. ■ 

Theorem 2.1. There exists a unique Nash equilibrium to the Bertrand game. 

Proof. We begin with the lowest cost firm. His equilibrium candidate price is given by p*' . If p*' 1 
is less than or equal to si then the optimal response of firm 1 is to set price equal to cost. By 
Lemma 2.1 every other firm has negative demand at cost. Hence, it is the best response of all firms 
to set price at cost. In this case, costs are so high that no firms receive demand in equilibrium, and 
we have 

p* = (si, . . . ,s N ) , (15) 



which is of Type (II) with n = 0. Alternatively, if p*^ 1 > s±, then additional firms may also want 
to price above cost. 

Suppose that for some n > 1 we have p*' n > Si for alH = 1, . . . , n. Consider the pricing decision 
of firm Ti + l. We find that if 

DlX\[ P r,...,pT,s n+l ) <0, (16) 

then firm (n + 1) will not want to price above cost because even at cost they do not receive demand. 
Furthermore, by Lemma 2.1 firms n+2, . . . , N will also not receive demand and their best response 
will thus be to set price at cost. Hence, we have a Type [(H)] equilibrium given by 

p* = ( p *- n , . . . , p *' n , Sn+1 , ...,s N ). 

However, if 

DlX\[ P r,...,pT,Sn + i) >0, (17) 

then firm n + 1 may want to price above cost. We must then distinguish two cases. The first is 
where p^+t 1 > s n+i- Then firm (n + 1) will want to price according to the interior candidate 
price, and all firms with lower cost will also price at their (ri + l)-firm interior candidate prices. 
At this point, we have to consider the entry decision of the next firm, thereby moving back to the 
beginning of this inductive step if n + 1 < N. However, if n + 1 = N then we stop and we have a 
Type |(I)| equilibrium given by 

* / *,N ±,N\ 

P = [Pi ,---,Pn ) ■ 



The second case is where p n ', j < s n+ \. Here, by Eqn. (17), firm (n + 1) wants to price above 
cost when the first n firms are pricing at their interior candidate prices in the n-firm game. But, 
its cost is too high to receive any demand at its (n + l)-firm candidate price. We say that this firm 
is on the boundary. Therefore, firm (n + 1) must set price equal to s n +i> because if they were to 
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price strictly above cost it would have to be an interior candidate price, and we already have seen 
that this is not possible for the given s n +i- We have thus ruled out both Type (I) and Type [(IT)] 
equilibria, and the equilibrium of this game is of Type 

Hence, the remaining firms solve for an equilibrium with the (n + l)-firm demand functions, but 
with p n +i fixed at s n +i. This will result in the prices p i ' n+1 ' 1 for firms i = 1, . . . , n. If Pn n+1,1 > s n , 
then we can stop and we have 



, fe,n+l,l 
P = [Pi 



_.&,ra+l,l „ 
,Pn , s n+l, •••,SJV 



(18) 



again where we know that all firms with cost greater than firm (n + 1) price at cost by Lemma 2.1 
However, suppose to the contrary that pn n+l ' 1 < s n . Then s n is too high to sustain a boundary 
solution with player n pricing above cost, and we must consider the situation where there is more 
than one firm on the boundary. We find k 6 {0, . . . , n} such that 



b,n+l,n—k . 
Pk+l <S k+l 



and 



b,n+l,n— k+1 
Pk > Sk- 



(19) 



Here k represents the number of firms setting price according to the boundary optimization Eqn. ( 13 ) 



and n — k + 1 is the number of firms on the boundary. From Eqn. ( 19 ) , the best response of each of 



the n — k + 1 boundary firms is to price at cost and, by Lemma 2.1 for the remaining higher cost 
firms to also price at cost. Meanwhile firms 1, ...,k choose prices p^ n+l ' n ~ k+1 w hich are greater 
than their costs. Thus, we have 



6,n+l,n— k+1 
Pi 



b,n+l,n— fc+1 
,Pk ,Sk+l, 



(20) 



2.3.2 Nash Equilibrium with Linear Demand 

We give explicit expressions for the Nash equilibrium to the Bertrand game under the linear demand 
functions discussed in Section I2T2I 



Proposition 2.6. There exists a unique equilibrium to the Bertrand game with linear demand. 
The type \(I}\ and \(II)\ candidate solutions are given by 



1 



Pi 



(2b n + c n ) 



na n + b n ^2 m =i Sm , t. 



(2b n - (n - l)c n ) 



The type |(//J)| candidate solutions are given by 



P. 



6,n+l,rt+l— k 



1 



f n+1 

a n +i + c n +i s r 



{2b n+ i + c n+ i) 

'n (a n+ i + c n+ i Emtfc+i s ™ ) + ELi s r 

-Cn+l 



m=k+l 
^n+1 „ \ , u V^fc 



26n+i - (k- l)c n+ i 



The Nash equilibrium is constructed as follows: 
• If si > ^, thenp* = (s!,...,s N ). 



Else, find n such that p*'' 1 > Sj, Vi = 1, . . . , n, and Pn+i 1 — s n+i 



(21) 



+ b n+1 Si 



. (22) 
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- If s n+ i > (a n+ i + c n+ i £™ =1 P*'") > i/ien = (Pi ") • • • 'K'™, «n+l, • • • , sn), 

— Else, 

6,n+l,l 



° ifPn^ 1 ' 1 > s n , thenp* = (p\ 
o else, find k < n such that 

6,n+l,7j+l— k 



6,71+1,1 6,71+1,1 

, • • • ,Pn j S n +1, ■ • • , SJV I , 



Pi 



> Si for all i = 1, . . . , k, and p^'™^ 1 '"^ 1 ^ k+1 ^ < 



+ I 6,71+1,71+1— k 6,71+1,71+1— k 

Thenp = [p{ , ■ ■ • >Pjfc > s*+l> • • • > «jv j ■ 



Proof. We first show that the first-order condition equation, Eqn. (11), has a unique solution. The 



second-order conditions that these are maxima for each player are satisfied as a straightforward 
consequence of b n > 0. In order to find a formula for p*' n , we first solve the unconstrained individual 
firm profit maximization problem to get the best-response function for each firm. This results in 



*,7l 
Pi 



1 



n C-n sr~^ *,n , 



(23) 



In order to find the intersection of all these functions, we sum Eqn. (23) over i to obtain 



p"" 



(2b n - (n - l)Cn) ' 



(24) 



where s n = Sj=i s i' ^be sum of the first n firms' costs, and p* ,n = ^" =1 Pj' • Rewriting Eqn. (23) 
in terms of p* ,ra gives 



Pi 



(2b n + c n ) 



[on + c n p*' n + 6 n Sj] . 



(25) 



Thus, our candidate solution p i ' , found by solving Eqn. ( 11 ), is given by Eqn. |25|) for i = 1, . . . , n 
and p*' n = Si for j = n + 1,...,N. This establishes the formulas in Eqn. (211). The p* ,n are 
necessarily positive because 2b n > (n — l)c n which follows easily from Eqn. (|5) and our standing 
assumption that B > (iV — 1)C (which is equivalent to (3 > 7). Therefore we have a unique Nash 
equilibrium of the subgame with positive prices. 



follows from the proof of Theorem 2.1 



The boundary formulas Eqn. ( 22 ) are established similarly, and the remainder of the proposition 



Remark 2.4. The condition for positive prices in the proof, namely 2b n > (n — l)c n , is exactly 



the diagonally dominant condition of Eqn. (12). 



2.4 Discussion of the Static Game 

The boundary type of solution we discuss above does not appear to exist in the literature on 
Bertrand games, which has primarily focused on cases where Type [(!)] equilibria occur. For example 
in the typically-studied case where firms are taken to have equal costs, the boundary would not exist 
because all firms would either price at cost, or they would all play an interior Nash equilibrium. 
However, this boundary type of solution may occur when firms have asymmetric costs. Consider 
a firm who prices strictly above cost in a boundary equilibrium. One can think of this firm as 
using price to discourage competition from other smaller or less efficient firms. In the simplest case 
of two players, a potential monopolist sets a price below the optimal monopoly price in order to 
discourage the entry of a possible competitor. Such practices are usually termed predatory pricing. 



12 



For further discussion, we illustrate with the linear duopoly. We assume we have linear demand 
functions in the sense of Section 2.2 with N = 2 for fixed constants A, B and C, with B > C. We 
use the result of Proposition 2.5 to re-parameterize the problem in terms of constants a, /3 and 7. 
For a fixed cost s, the optimal price and realized demand in the monopoly problem are given by: 



1 



Pm(s) = o ( a + s ) > D *m( s ) 



1 

2^ 



(a 



(26) 



In terms of the players' costs (si, s 2 ), the interior equilibrium duopoly prices and demands are given 
by 



Pi {Sl,S2) 



D*( Sl ,s 2 ) 



a 



P~l 
2/3-7 



+ 



P 



P 



(4/32 



7 Z 



(2/3 Si + j Sj ) 



1,2; j^i, 



/3 + 7 (/3 2 - 7 2 ) 



(/32 



:P*j{si,s 2 ). 



Finally, if the boundary case arises, the equilibrium prices are given by 



6,2,1/ \ 

Pi {si,s 2 ) 



P 



and 



Pi 



(27) 
(28) 

(29) 



which can be found from the two-player profit maximization problem under the assumption that 
one's opponent sets price equal to cost. If i denotes the lower cost firm such that < Si < Sj, then 
the Nash equilibrium price strategies are given by 



Pi 



max 



and p* = max ( Sj^p*' 2 J . In the case s\ = S2 



( 



\ 



P M \ S i) 
6,2,1/ s 
Pi {81,82) 
*,2 
Pi 



if 
if 

else 



Dj(p* M (si),Sj) < 



D j(PMi s i), s j) > and P*/ < s . 



(30) 



s, this simplifies to p\ = p\ = max ^s, a ^ 2 p-^ 3 ^\ • 

We examine the above solutions in more detail. Let us first note that if p{ < si, then a 
duopoly is not sustainable. This occurs if and only if 



^(si) 



2/3 2 



7 



Pi 



si 



a 

~Pl 



(/3- 7 ) (2/3 + 7 ) >s 2 . 



(31) 



Similarly, we note that if D\ [si,p k M {s2)) < 0, then Firm 2 has a monopoly. This occurs if and only 
if 



2/3 



a 



02 (si) A ^ Sl _ "(2/3-7) >s 2 . (32) 
7 7 

Therefore, for s 2 G (0 2 (si), c/> 1 (si)) , Firm 2 cannot sustain a monopoly, but neither is a duopoly 
sustainable. This is the situation where Firm 1 is on the boundary. By the symmetry of the game, 
we can also use (ft 1 and (j> 2 to characterize where Firm 2 is on the boundary, and where Firm 1 
has a monopoly. We can fully characterize the type of game in the space of (si, s 2 ) through these 
two functions. First, note 1 (a) = (p 2 (a) = a, and 1 (s) — </> 2 (s) = ^ (a — s). We see in Figure jlj 
that as long as \si — s 2 | is relatively small, a duopoly will be sustainable. We also note that the 
dependence of </> 1 (s) — </> 2 (s) on 7 implies that as 7 decreases, the size of the boundary area will 
also decrease. Consider a fixed set of costs (si,s 2 ) such that si > s 2 and s 2 = <^ 2 (si). This is the 
point where the game transitions from the boundary solution to the monopoly solution. Using the 
monopoly price and boundary price given above, we find at this transition point that 



P*M {<P 2 (si)) 



P2 2,1 (8l,4> 2 (si)) 



1_ 

2/3 



(a 



si) > 0, 
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a s\ 



Figure 1: Characterization of solution in cost space 

and thus there is a jump in the equilibrium price of Firm 2 as the game transitions from Firm 1 on 
the boundary to Firm 2 being a monopoly. 

3 Differential Game 

The single-period game provides only the beginning of an insight into the pricing decisions of 
firms. In reality, firms make their decisions dynamically through time. We consider a market in 
which there are N possible firms, each of which has a fixed lifetime capacity of production at time 
t = denoted by Xj(0), and where Xi{t) denotes the remaining capacity at time t. The firms in 
this market produce only a single good and thus, one can use the terminology firm and product 
interchangably. In this sense, Xi(t) represents the remaining amount of a certain product that will 
be sold. Therefore, when Xi = 0, no more of the product will be sold, the firm has exhausted its 
capacity and is out of business. Thus, Xi is not to be confused with inventory which is typically 
replenishable. Our point of view abstracts from the microscopic level of inventory fluctuations to 
the level of lifetime production. For simplicity of notation, we consider the cost of production in 
the dynamic game to be zero, but we will see there are shadow costs associated with scarcity of 
goods as they run down. 

Each firm i chooses a Markovian dynamic pricing strategy, pi = Pi(x(t)) where x(t) = (xi(t), . . . , xn 
This is the price at which consumers can purchase a unit of the good produced by firm i. The firms 
in this market produce substitute, but not perfectly substitutable, goods. As in Section [2j given 
these prices, each firm i = 1, . . . ,N expects the market to demand at a rate Di(px,p2, ■ ■ ■ ,Pn), but 
actual demands from the market may see short term unpredictable fluctuations. We model them 
in the simplest way: 

di(t) = Di (pi,p 2 , • • • ,Pn) ~ <7i£i(t), (33) 

where {ei(t)} i=1 N are correlated Gaussian white noise sequences. Consequently, the dynamics 
of the lifetime capacity of the firms is given by dxi(t) = —di(t) dt. This leads to the controlled 
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stochastic differential equations 

dx i (t) = -D i (p 1 (x(t)),...,p N (x(t)))dt + a i dW i (t), ifsi>0, i = l,...,N, (34) 

where {Wi(i)}i=i . n are correlated Brownian motions. If Xi{t) = for any t, then Xi(s) = for all 
s > t: random shocks cannot resuscitate a firm that has gone out of business. The use of this type 
of additive shock in demand is common in the economics literature, for example Arrow et al. p]. 
The use of a Brownian motion for the demand flow can be found in various sources, for example 
Bather [3|. An alternative model for demand uncertainty in the literature is to consider the process 
of customer arrival as a Poisson process, see for example Besbes and Zeevi [8] for recent work in 
this direction. 



3.1 The Linear Demand Duopoly Game 

Now that we have fully specified the dynamics of the firms' remaining lifetime capacities, we move 
on to the actual study of the dynamic game. The analysis can be done for an arbitrary number of 
players N, but, to simplify the exposition, we focus on the case N = 2, i.e. duopoly. Additionally, 
we focus on the case of a linear demand system. This will allow us to be more explicit in our actual 
results. See Appendix [C] for a discussion of the A^-player linear demand game. 

Given initial lifetime capacity Xj(0) > 0, player i = 1,2 seeks to maximize his expected dis- 
counted lifetime profit 

E ( / e- r *Pi(x(i))A (pi (x(t)) ,p 2 (x(t))) l {x , (t )>o} dt) , (35) 



where r > is a discount rate and Di are the actual demands constructed in Definition 2.2 using 
the linear demand functions given in Section 2.2 We restrict attention to Markov Perfect Nash 
equilibria in order to rule out equilibria with undesirable properties such as non-credible threats 
(see, for example, Fudenberg and Tirole |X9^ Chapter 13]). This means that we are looking for a 
pair (pi(pc.(t)),P2(x(t))) such that for i = 1, 2, j ^ i, and for all x(0) S M+, 



E [Jo e ~ rtp ' {x{t)) Dl ® (x(t)) (xW) ) 1 {^(*)>°> dt ) ~ 
E { I e- rt Pi (x(t))Di ( Pi (x(t)) ,p* (x(t))) l {Xli t )>0} dt) , 



for any Markov strategy p% of player i. (The overbar in p* is used to distinguish the dynamic Nash 
equilibrium from the equilibrium of the static game in Section [2]). 

We define the value functions of the two firms by the coupled optimization problems 

V i (x 1 ,x 2 ) = su P e{ / e~ rt p l (x(t))D i (p l ( X (t)),p 2 (x(t)))l {xi{t]>0} dt) , i = l,2. (36) 
Pi>0 I Jo ) 

Then, by a dynamic programming argument for nonzero-sum differential games (see, for example, 
Friedman [T71 Section 8.2], Ba§ar and Olsder [2J Section 6.5.2], or Dockner et al. [131 Section 4.2]), 
these value functions, if they have sufficient regularity, satisfy the following system of PDEs: 

CVi + sup <^ -D x ( Pl ,p 2 ) Tr^-D 2 (p l5P2 ) —L + Pi Di ( Pl ,p 2 ) \ -rVi = (37) 
Pl >o I oxi ox 2 J 



15 



for i = 1, 2, where 



C 



i 2 a 2 



d 2 



l 



a 2 



dx\dx2 2 <T2 ~ <9x 2 ' 



C 2 * ^u, 2 

and /9 is the correlation coefficient of the Brownian motions: E {dWidW^} = pdt. 

When the parameter 7 is not too large, both players are close to being monopolists in disjoint 
markets for their own goods, and we can expect that the dynamic Nash equilibrium (pj(x(t)),p^(x(i))) 
is such that both demands Di (p£(x(t)), P2 ( x (^)) ) remain strictly positive while X{(t) > 0. We shall 



find that this is indeed the case for small enough 7 in the asymptotic solution of Section 3.3 and 
the numerical solutions in Section |4j 



When both demands are positive, we see easily from Propositions 2.4 and 2.5 that the linear 
demand functions satisfy the relationship 

7 



Dj(pi,P2) = D M (j>j) ~ «A(Pl,P2), 3 ¥= * 



which allows us to re- write Eqn. (37) as 



CVi - D M (pj)^ + sup 
OXj Pi >o 



Di (pi,P2) 



Pi 



dxi 



1 m\ 

Pdxj) 



rVi = 0, 



1,2. 



(38) 



(39) 



We now observe that the Nash equilibrium problem in the two PDEs in Eqn. (39) is exactly a static 
Nash equilibrium problem for a two-player Bertand game, but with costs 

dVi , , 7 dVi 



Si 



x 



dxi 



x 



j3 dxj 



x 



1,2. 



(40) 



Given the unique Nash equilibrium p\ (S\ (x) , Si (x)) of this static problem from Proposition 



2.6, the PDE system is simply 



BV- 

CVi ~ D M {p* (S 1 (x) , 5 2 (x))) g^ + Gi (Si (x) , S 2 (x)) - rVi = 0, i,j = 1, 2; j ± i, (41) 

where we define Gi(s\,S2) = Di (p\,p%) (p* — Sj) as the equilibrium profit function of the static 
game. 

The domain of the PDE problem is x\ > 0, x 2 > 0. When one firm runs out of capacity, the 
other has a monopoly. We denote by vm{x) the value function of a monopolist with remaining 
capacity x, which we will study in the next section. On rr 2 = 0, x\ > 0, Firm 1 has a monopoly, so 
V2(x\, 0) = and Vi(x\, 0) = vm(xi). On x\ = 0, x 2 > 0, Firm 2 has a monopoly, so Vi(0, x 2 ) = 
and 1^(0, X2) =vm{x2)- 

As is well known, it is extremely difficult to provide existence and regularity results for systems 
of PDEs arising from nonzero-sum differential games and we do not attempt to do so here. Some 
results on weak solutions are found in Bensoussan and Frehse [3 13] , for related problems on smooth 
bounded domains with absorbing boundary conditions. In contrast, zero-sum games, which are 
characterized by a scalar equation, have a well studied viscosity theory; see, for example Fleming 
and Souganidis [16] . Mean Field Games are an intermediate case characterized by a system of two 
PDEs and some regularity results exist (Lasry and Lions [25]). We also mention some analytical 
progress can be made in nonzero-sum stochastic differential games of Dynkin type, that is games 
on stopping times; see Hamadene and Zhang [21J. 

In the stochastic game, the intuition is that the elliptic operator C will provide regularity 
which is supported in the numerical results of Section [4} In the non-stochastic game, when 7 is 



small enough, we obtain regular asymptotic approximations in Section 3.3 because the strength of 
competition between firms is weak. 
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3.2 Monopoly Problem 

When one firm has a monopoly over the market, the dynamics for the firm's remaining capacity, 
x(t), is given by 

dx(t) = -D M (p(x(t))) dt + adW(t), 

where W is a Brownian motion. The value function of the monopoly firm as a function of its initial 
capacity xq = x £ M+ is defined to be the maximum expected discounted lifetime profit 



v M (x) = supE <^ / 
p>0 {Jo 



-l-t 



p (x(t)) D M (p (x(t))) l{ x (t)>o} dt 



(42) 



The associated Bellman equation for this stochastic control problem is the ODE 

1 



-a 2 v M + sup {D M (p) (p - v' M ) } - rv M 



0, 



with boundary condition v m(0) = 0. We look for solutions in which lim^oo v' M (x) = 0. 
As we are working in the case of linear demands, we find from Eqn. (26): 

2<r 2 v M + — (v' M -a) 2 - rv M = 0. 

In the case a = 0, the monopoly ODE is given by 



1 

4/3 



(v' M - a) 2 - rv M = 0, 



(43) 



(44) 



and we can find an explicit solution. 

Proposition 3.1. The value function for the monopoly with a = is 



a 



VM{ - X) = Wr ^ 



+ 1 



(45) 



where /i = (2/3r)/a and W is the Lambert W function defined by the relation Y = W(y)e w ^ 



-i 



with domain Y > — e 

Proof. It is straightforward to check that the Lambert W function satisfies W(z) < for z G 
[-e" 1 ^), W(-e" 1 ) = -1, W(0) = 0, and W'{z) = W(z)/ (z (1 + W(z))) for z > -e _1 , and 
therefore that Eqn. ([45]) indeed satisfies Eqn. p4] ) and the boundary condition ujvf(0) = 0. We 
note that the restriction of the domain of W to [— e _1 ,oo) is sufficient as the argument to W in 
Eqn. (45) is equal to — e _1 when x = and increases to zero as x increases to infinity. ■ 



Inserting s 



J M 



■qW 



~fj,x— 1 



), into the optimal monopoly price strategy and demand 

) ) . We plot this function in 



-fix— 1 



functions given in Eqn. (26), we findp^- (v' M (x)) = § (l — W 

Figure [2] We note that the price at the zero capacity level is given by a, and in the limit as x — > oo, 
P*M ~^ f • The demand is given by D* M (v' M (x)) = (a — v' M (x)) = ^ (l + W (— e - ^' -1 )) , which 
is strictly positive for all x > 0. 
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Monopoly Price Function 



- Price 

" a 
a 1 2 



Figure 2: p* M (x) vs x for a = 



3.3 Small Degree of Substitutability Asymptotics under Deterministic Demand 

We further analyze the non-stochastic (or ordinary) differential game (07 = a 2 = 0) in which the 



monopoly problem is explicitly solvable, as in Proposition 3.1 We first note that 7 = is equivalent 



to stating that firms have independent goods in the sense that they operate in markets without 
competing with one another. Hence, they have monopolies in their own markets, and it is clear that 
Vi(x\,X2) = j)m(i)), where vm is the monopoly value function given in Eqn. (45). When 7 > 0, 



firms produce goods that are substitutable and are actually in competition with one another. We 
construct a perturbation expansion around the non-competitive case for small 7 > to view the 
effects of a small amount of competition. 



Recall our PDE system Eqn. (41), with C = 0. We look for an approximation to the solution 

(46) 



of this system of PDEs of the form 

Vi(xi,x 2 ) = v M (xi) +ivf\x 1 ,x 2 ) + 7 2 vf\xi,x 2 ) H • 



We use the static equilibrium price and demand functions that are given in Eqn. (27)-Eqn. (28), 
because we are working under th< 
first expand S{ (x) = (x) + 7s 

,(0) 



because we are working under the standing assumption that we have a Typ e |(I)| equilibrium. We 
?(°) M _i_ ^J 1 ) ( x ) _|_ 7 2 s^ 2 - ) (x) + • • • , where from Eqn. (40), we have 

,(2) 



/ / n (1) _ 9v i ' (2) 



(1) 



dv) 



1 dv 



dxi 



dxi 



(5 dxj 



Making use of Eqn. (26), the relevant expansions in powers of 7 are 

„2 



Pi{si,s 2 ) 
Dm (p!) 



PIM 0) ) - \D* M (sf + 2/3^) - ^D* M (sT> + 2 P sf + 4fs®) + 



D* M (s 



(0)^ 



7 D* (s {0) 



2^) 



3f_ 

4/3 2 



D M (sf ] + 



(i) 
3 



2 D (2)> 



+ 



D M (8?1) + ^DUsf + 208?) + ^D M (^ + 2fis? + tfsf >) + • 



4/3 2 



(47) 

(48) 
(49) 
(50) 
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We define 



l(x)±D\ i {v> M (x)) = -{a-v> M {x)). 



(51) 



Then, inserting Eqn. (46) into Eqn. (41), using Eqn. (|48[)-Eqn. (1501) , and comparing terms in 7 and 



7 2 , give that and vf satisfy 



(2) 



<?(Zl) 



<9t> 



(2) 



9xi 



+ q(x2 



(2) 

ox 2 



-q(x 1 )q(x 2 ), 

1 (dvf ; 



(52) 



dv) 



(i) 



9a; i 



+ 



1 I dv 



(i) 



4/3 V 9xi ' ' 1V J ' 



2>3 (9(Xi))2 ' 



(53) 



for 2 = 1,2 and j 7^ i, with boundary conditions «j (a?i,0) = Uj 2 ^(a?i,0) = and Uj(0, £2) 
vf } (0,x 2 ) = 0. 

Proposition 3.2. TTie solution is given, for x\ > x 2 , by 



where 



a 



v\ 1 \x 1 ,x 2 ) = (e~ rQ ^ (1 + rQ(x 2 )) - e~ rQ ^ (1 - rQ(x 2 )) + e -r(QM+Qi^)) _ ^ ( (54) 



Q(x) 



* ^-du = -- log (-W (-e^ 1 )) , 



(55) 



and, for x 2 > Xx, fry reversing the roles of x\ and x 2 in Eqn. (54)- The solution for v*p is clearly 
r/ie same, i.e. v 2 = v{ . 

Proof. The first step is to make the change of variables (£,rj) = (Q(xi),Q(x 2 )) and u(£,r]) = 



C 2 



(Q 1 (C))Q 1 (77)) in Eqn. (52), which gives 



du du 
<9£ dn 



f(Z,v), Z,V>0; u(C,0) = «(0,77) = 0, 



(56) 



where /(£, r/) = — ea^+^g (Q _1 (£)) g (Q _1 (^/)) • We see by the symmetry of this equation that 
u {^y r l) = li ( r /)C)- We first suppose that £ > 77 and solve the PDE with the boundary condition 
0) = 0. The other half of the solution can be obtained by symmetry. The solution is 

V) = r f(s + e - r?, a) cfe = - f el^+^g (Q" 1 (s + £ - 77)) g (Q~ x («)) (is. (57) 
jo io 

By the definition of q(x) in Eqn. (51 ) and vm in Eqn. (45), we have q(x) = ^ [l + W (— e"^ -1 )] . 
This leads to Eqn. (55) since the range of W (— g - ^ -1 ) is (—1,0). From properties of the Lambert 
W function, it follows easily that — e~ rs = W (— e - ^ ), and hence 



(Q •(.!) • wf < < 



a; 
2^ 



;i - e -») . 



(58) 



We can now easily compute the integral in Eqn. (57). After restoring the transformations, we 
obtain Eqn. (54). ■ 
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3.2 



Remark 3.1. It can be verified by direct computation that the solutions in Proposition 
are C 1 on the line x\ = X2- One can also solve the PDEs in Eqn. (53) to obtain a second-order 
correction for the value functions. We present this solution in Appendix [B| 

Remark 3.2. While we do not give a formal convergence proof for the asymptotic approximation, 
we note that, since vf' and are bounded with bounded continuous first-derivatives, the error 
terms Ei defined by Vi = vm + 7%- + l 2 vf^ + E{ solve 

with Ei(x\,0) = Ei{Q,X2) = 0. It follows from here that, for fixed x\,X2 > 0, \Ei{x\, X2)\ = 0(7 3 ) 
as 7 I 0. 



3.4 Discussion of Asymptotic Solution 



We plot in Figure 



Intuitively, it decreases from zero on the axes, because the first order 
ue of the game due to the transition from a one-player monopoly to a 



correction decreases the va 
two-player duopoly game. Hence, the greater the value of 7, the lower is the lifetime profit of an 
individual firm. 




Figure 3: and First- and second-order value function corrections. 



We plot in Figure jj b) It is again negative everywhere. Hence, the second-order correction 



serves to further decrease the value of the game from just the first-order approximation. We plot in 
FigureU the difference between and ■ We do not make the same comparison for vf"' because 

v± — = 0. We see from this figure that the sign of the difference is equal to the sign of x\ — X2- 
Consider the situation in which Firm 1 has larger lifetime capacity, x\ > X2- In the absence of 
competition, he has a larger value function, vm( x i) > wm(^)' Introducing competition lowers his 
value by less than it lowers the value of the smaller firm. Therefore, competition serves to enhance 
the advantage of the larger firm. Of course, when two firms both have large remaining capacities, 
the inequality between firms does not have that much importance. It is only when one or both 
firms have small amounts of capacity remaining that inequalities across firms become magnified. 



20 



v (2) _ „(2| 
1 2 




20 20 



(2) (2) 

Figure 4: v \ — v\ ■ Difference between Firm 1 and Firm 2 second-order value function corrections. 



1 



For the remaining figures of this section we use the expansion up to order 7. We plot in Figure 
) the equilibrium price strategy of Firm 1 as a function of X2 for various values of 7 using the 
first two terms of Eqn. (48). For 7 = 0, p\ does not change with xi as the goods are independent. 
For increasing 7, as we would expect, the prices decrease at a faster rate as a function of X2 because 
is more sensitive to the price of firm 2 when 7 is larger. In Figure HTb) we plot the instantaneous 




22 5 10 15 20 4 0.1 0.2 0.3 0.4 0.5 0.6 

x 2 Y 

(a) Equilibrium price as a function of X2 for xi — 10 (b) pi x Di (p{,p2) as a function of 7 for x\ — 10 
fixed 

Figure 5: Equilibrium Price and Profit for Firm 1 

profit for Firm 1, PiD^p^^p^)- Each line shows the impact at a fixed (xi,X2) of increasing 7, and 
we see from the slopes that the effect on reducing instantaneous profit is greater when X2 is larger. 
Hence, competition, as measured by 7, only has bite when the competitor has comparable lifetime 
capacity levels. 

Thus, when one considers the effect of competition on profit and prices, there are two main 
pieces of information one must take into account. The first is the degree of substitutability between 
goods. Fundamentally this means how similar is your good to your competitor's. For example, one 
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expects 7 to be large in the market for gasoline, because gas at one station is essentially the same 
as gas at a station across the street. The goods are not perfect substitutes because of travel costs, 
brand loyalty, and a host of other reasons. However, in the market for CDs, one expects a very 
low degree of substitutability, because an individual artist's music is typically highly differentiated 
from that of another artist, even within a specific genre. It is reasonable to assume in such a market 
that 7 is quite low. 

The second main piece of information is how credible is your competition. In this model, the 
proxy for a credible competitor is their level of lifetime capacity. If your competitor has very little 
lifetime capacity, then it stands to reason that regardless of how similar their good is to your own 
good, you will be a monopoly in short order. In contrast, if your competitor has a large amount 
of lifetime capacity, then they are a very credible threat to your business. As such, you must take 
such them very seriously even if their good is highly differentiated (but still substitutable) with 
your good. This can be seen in Figure I [b) as even with 7 = 0.1, when X2 is large relative to a?i, 
the instantaneous profit is much less than when X2 is relatively small. 

In Figure [ij we plot the solution to ^ = —D\ (j?^(x),p£(x)), where we have used our expansion 
of order 7. We present the path of x\(t) over time for various different values of 7 starting from 
xi(0) = £2(0) = 10. We see that as 7 increases, the time of the game increases. That is, it 
takes more time for Firm 1 to deplete their lifetime capacity when the degree of substitutability is 
greater. We can see this also by looking at the path of both demand and prices over the time of 



Path of game for Firm 1 
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x 
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Y=0.05 
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Figure 6: Path of Firm 1 Lifetime Capacity over time with xi(0) = £2(0) = 10 for various values 
of 7 



the game. These are plotted in Figures [7 (a)| and |(b)[ respectively. We see that, for an individual 



firm, increasing the value of 7 drives down the price, while the demand first decreases and then 
increases. Common across all levels of 7, we see that as the capacity of the firm diminishes over 
time, the price increases while demand decreases. 

Finally, we remark that one can confirm that the resulting demands from the asymptotic ap- 
proximation for both firms are strictly positive in equilibrium. Therefore, our previous assumption 
on strictly positive demands is justified at least for 7 small enough. 
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4 Numerical Analysis 

We have been able to capture many of the qualitative features of the model analytically in the 
case of deterministic demand using the asymptotic expansions of the previous section. However, in 
order to fully analyze the stochastic model we solve the full PDE system numerically. With these 
solutions, we then simulate paths of the game. 



4.1 Finite Difference Solution of the PDE System 



We employ fully implicit finite differences to find solutions V\ and V2 to the system in Eqn. (41). 
We can then use finite difference approximations to the derivatives of these value functions to 
obtain optimal price strategy functions and the resulting optimal demand functions. We use the 
parameter values a = 6, /3 = 1, r = 1, a\ = 0% = 0.6 and p = 0.1. The demands remain strictly 
positive for this choice of parameters and therefore, in this case, both firms are active participants 
in equilibrium. 

For given levels of capacity x\ and X2, we define 9 = tan -1 (X2/X1). This is the angle in (x\, x^) 



space that corresponds to the given capacity levels. We plot in Figure |8||(a) the price of Firm 1 



as a function of this 9 for several values of 7. We also plot the optimal demand as a function of 



9 in Figure 8 (b) These figures allow us to analyze price and demand effects for a fixed level of 
overall capacity in the market. At one end of the spectrum, 9 = 0, we have that Firm 1 controls 
all of the capacity in the market. On the other end, 9 = vr/2, Firm 2 controls all of the capacity. 
The price of Firm 1 decreases initially as 9 increases, provided there is competition in the market, 
i.e. 7 > 0. However, the price starts to increase once 9 moves beyond 7r/4 and Firm 1 holds the 
minority share of the available capacity in the market. Furthermore, price decreases at a greater 
rate for higher levels of 7. This implies that the optimal price strategies result in the lowest prices 
when substitutability is high, i.e. 7 is large, and when all firms in a market are of the same relative 
size, i.e. 9 is close to tt/4. Increasing the number of firms in a market, thereby increasing the 
level of competition, does not always have a large effect on consumer welfare. This is because if an 
additional firm enters a market with a small capacity when there already exist large capacity firms, 
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Figure 8: Price and Demand for Firm 1 as a function of 8 for various values of 7 



then essentially this means they are not credible competitors to the large firms and therefore prices 
do not necessarily have to adjust by a large amount to account for this additional competition. 
On the other hand, we see from these figures, for a given fixed level of total market capacity, 
consumers are always better off if the capacity is spread evenly across firms, provided the firms 
produce substitute goods (i.e. 7 > 0). Consumers therefore face the best possible situation when 
there exist multiple firms in a market whose goods have a high degree of substitutability and whose 
relative sizes are the close to the same. 

Figures 9~| |(a) and |(b)| are the contours of the optimal price strategy for Firm 1 for two different 



values of 7. The strategy changes from charging a constant price as a function of X2 when 7 = 0, to 
charging a price that is decreasing in X2 for 7 = 0.4. This is as expected because prices should reflect 
the credibility of one's competitor when that competitor produces a good which is substitutable 
with one's own good. We see that although prices are decreasing in both x\ and X2, they decrease 
at a faster rate with respect to x\. 

4.2 Game Simulations 

We can use our numerical solution of the value functions to obtain numerical versions of the equi- 
librium prices, p*(x(t)). These in turn can be used to obtain numerical versions of the equilibrium 



capacity trajectories over time by making use of Eqn. (34), i.e. 



dxi(t) = -Di(pt(xi(t),X2(t)),pZ(xi(t),x 2 (t))) dt + aidWi(t), i = 1,2. 

We simulate paths of the Brownian motions in order to obtain paths of the game over time. We 
present an example of these paths in Figure lC|a) for 7 = 0.4. This is just one example but 



it displays many features of the game. Here we started both firms with an initial capacity of 
£i(0) = £2(0) = 10. Over time these decrease, but because of the stochastic component of demand, 
we see that at any given moment in time, we cannot say with certainty which firm will necessarily 
have a higher level of capacity. In this example, initially Firm 2 gains an advantage, however we see 
as time progresses that Firm 2 runs out of capacity before Firm 1, and hence for a period of time 
Firm 1 has a monopoly. For a fixed realization of the Brownian path, we plot in Figure lC|[b) the 



path of the capacity for Firm 1 for various values of 7. We see that as 7 increases, the time until the 
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Path of Stochastic Game with y = 0.2 Path of Game for Firm 1 




Time 



(a) Path of Stochastic Game for both firms with 7 = 0.3 (b) Paths of game for firm 1 for varying 7 

Figure 10: Path of Stochastic Game 
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capacity of Firm 1 is exhausted, also appears to increase. This effect, where increased competition 
prolongs the lifetime of firms, is consistent with what we saw in Figure [6] in the deterministic game. 



5 Conclusion 

We have studied nonzero-sum stochastic differential games arising from Bertrand competitions, in 
particular, the case of a duopoly with linear demand functions. By considering the case where 
there is a small degree of substitutability between the firms' goods, we are able to construct an 
asymptotic approximation that captures many of the qualitative features of the ordinary differential 
game. Numerical solutions further provide insight into the stochastic case and where there is a 
higher degree of substitutability. In our study of the dynamic game, we concentrated on the case 
where both firms have positive demand in equilibrium. As we saw in the static game, it is possible 
for there to arise cases where this does not occur. However, the study of such cases remains an 
interesting open question in the analysis of these dynamic Bertrand games. 

These tools allow us to quantify the effects of substitutability and relative firm size on prices, 
demands and profits. In particular, we find that consumers benefit the most when a market is 
structured with many firms of the same relative size producing highly substitutable goods. However, 
a large degree of substitutability does not always lead to large drops in price, for example when 
two firms have a large difference in their size. That is, consumers benefit the most when firms are 
competing with other firms whom they deem to be credible threats. A competitor is a credible 
threat only if they have capacity large enough to match their competitors. For example, the 
existence of a very small coffee shop does not greatly affect the pricing decisions of Starbucks. 

It is of interest to extend the analysis here to markets with nonlinear demand systems as well as 
to random demand environments. By the latter, we mean that baseline demand and substitutability 
may vary stochastically over time with economic conditions or consumer tastes. For example, in 
the linear demand system Eqn. ([2]), there may be fluctuations in the intercept parameter A, which 
is a measure of the general level of demand due to business cycles and recessions, or in C/B, which 
is the measure of substitutability, as certain brands fall out of fashion, for example what Toyota 
is experiencing in 2010. Finally, an important related direction is to connect, in a probabilistic 
way, prices to the mechanism of customer arrival, for example, by making the arrival intensity a 
function of prices. Such models have been used in a variety of applications for the single-player 
price setting problem. However, their use in competitive markets leads to multi-player stochastic 
differential games with jumps, and is a direction we are currently pursuing. 



A Proof of Proposition 2.2 



We have assumed that pjy exists. We show that this implies pn-i exists. The result for all n will 
then follow by induction. Fix pi, ■ ■ ■ ,Pn~2 and denote this vector of prices by p. Let pn-i be an 
arbitrary price. We denote Pn(p,pn-i) by p. We then have two cases, depending on pn-i, under 
which we wish to show D^z{ (p,PN-l) < 0. The first case is pn-i > Pn(p,P), which implies 



D N-1 (P,PN-l) = -DaT-1 (P>PiV-l,P) = D% (.P,P,PN-l) < Dn {P,P,P(P,P)) = 0. 

The second case we must consider is the reverse inequality, i.e. pjv-i < Pn(p,P)- This implies 



= D N (P,PN-i,p) > D% {p,p(p,p) ,p) = £>$_i (p,p,p(p,p)) = £>^_{ (p,p) 



N 



y/V-1 
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Hence, regardless of the relative size of pn-i and Pn (p,P), we have that D^z\{p) is negative for 
some vector of prices p. We have ignored the case pn-i = Pn(p,P), because this would change the 
above inequalities to equalit ies a nd we would have the choke price we are looking for. 

We know by Assumption 2.4 that D^z{ is a decreasing function of Pn—1- We have shown above 
that there exists some vector of prices p such that D^z\(p) < 0. We thus need only show that 
there exists some vector of prices p where D^Z\(p) > 0. This will establish the existence of the 
choke price. 

Fix some vector of prices p = (pi, . . . ,pjv-2> 0), where pi, . . . ,pn-2 are arbitrary prices. Denote 

)# (0, 0) > D N N 

Pn (0) > 0. We then have 



by the vector in M^" 1 of all zeros. Recall that D% (0,0) > (0,p N (Q)) = 0. This implies 



D%Zi (P) = D%_ x (p,p N (p)) > D%_ t (p,p N (0)) > £^_! (p, 0) > D%_ x (0, 0) = D% (0, 0) > 0. 

Hence, for the vector p we have that D^z\{p) is positive. Therefore, there must exist some pn~i 
for every set of prices pi, ■ ■ ■ ,Pn-2 such that D^z\ {pi, ■ ■ ■ ,Pn-2,Pn-i) = 0. 



B Second-order approximation 



We give the solution of the PDEs Eqn. (53) for vf^ ■ Using the solution to found in Proposition 



3.2, making the same change of variables (£, rj) = (Q(xx), Q(x 2 )) and solving leads to 



,( 2 ) 



a 



-rQ(x 2 ) 



Q{x 2 ) 2 ( 2re r ^ x '^ | rtpi 



Q(x 2 )(l-V>i) 



2 \ e r Q( x 2) - 1 1 - e _r< 2(zi) / 1 - e -rQ(»i) 

2 



ll-<Pl) 



I [ rQ(x 2 ) j 

2r V J 2r (e r Q( x *) (l - e-rQM)) ' 2 



1 - ipx 



r 



e rQ(?») _ (fie-rQte) - i + $ - 2tpirQ(x 2 ] 
for x\ > X2 where tpi = exp {— r (Q(xi) — Q(x2))}. For x 2 > x\, 



,(2) 



a 



I 3 
3 



-rQ(xi) 



Q{x\) 2 ( re 



rQ{x\) 



+ 



2rip 2 



\ 2Q(gi)(l-y a ) 

2 \ e rQ(xi) _ l 1 l _ e ~rQ(x 2 ) J l _ e -rQ(x 2 ) 

1-<P2 



4 _ | e rQ(x!) _A ( 1 ~ ( ^ 2 ) 2 

2r V / re^Q^i) (l - e-^fca)) 



+ 



e rQ(xi) _ 2r Q(xi) - e - r Q( xl ) 
where tp2 = exp{— r (Q(x 2 ) — Q(x\))}. We omit the details of this lengthy calculation. 



(59) 



(60) 



C iV-player Stochastic Differential Game with Linear Demands 

Consider the iV-player dynamic Bertrand game under the linear demand system introduced in 
Section [3| Within this section we explicitly assume that all firms participate in equilibrium, i.e. 
all firms receive positive demand. In the language of Section [2j this would mean that the resulting 
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dynamic equilibrium is of Type |(I)[ Let Vi (x) denote the value functions defined by the iV-player 
analog of Eqn. (36). Then, the associated PDE system, analog of Eqn. (37), is 

{ N dV ) 

CVi + sup < - V £>f 0) tt^- + PiDf(p) \ ~rVi = 0, i = l,...,N, (61) 

where we explicitly denote the dependence of the demand functions on N to indicate the size of 
the vector p in the argument. Here, 

1 - N a 2 v 

HZI>4^ («) 

8=1 3 = 1 J 



where (Sy), . =1 N is the covariance matrix between the Brownian motions in Eqn. (34). 
For a fixed i, we note that we can write 

Dfw = -§A"(P)+^(i + §)-B(i-g)« + c(i + §)E» 



C 



= -^D-(p)+D^(p. l ), (63) 
where p-i = p\{pi} and 

'<«-{*-!, til < 64 > 

This decomposition means that one can represent a firm's demand function at the level N as a linear 
combination of another given firm's demand function at the level N and their own demand function 
at the level N — 1 with the given firm being removed. This is a consequence of the consistency of 
demand functions and the existence of choke prices. 

Hence, using this decomposition, we have, for i = 1, . . . , JV 

™ - 1 - s { Dfw ( B - i + § £ S) } - = <«» 

Therefore, we can use the results of the static Bertrand game to write the PDEs as 

N BV 

CV * ~ E K^iPU)^ + G?(s u ...,s N ) = rVt (66) 

where the prices p* are the solutions of the iV-player static game with costs 

dVi C^dVi AT 
5!(X) = ^-^V . = 1,...,* (67) 

and with corresponding profit functions Gf (si, . . . , sn) = D^(p*) (p* — Sj). 

The boundary conditions for this PDE depends on the PDEs that result by considering a market 
with N — 1 firms. That is, on any edge of an orthant where Xi = and xj > for all j ^ i, we 
have Vi = and that Vj solve the same PDE problem except where firm i is removed and thus 
there are N — 1 firms in the market. This is similar to the duopoly problem where the boundary 
condition depends on the monopoly problem. The remaining conditions can be worked out in a 
similar fashion. 
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